Steve Yegge spent $120k/month running 50+ Claude agents to build a video game, and discovered they'd constructed an entire governance framework with constitutions and courts instead of traditional engineering systems. He argues that future AI management will rely on laws and institutional structures rather than sandboxes and technical constraints.

• Yegge's Fable-tier agents autonomously built a legal/governance system (complete with constitutions, courts, and case law) while he expected engineering infrastructure, suggesting advanced AI naturally gravitates toward institutional rule-making
• Current safety focus on sandboxes and guardrails works for lower-tier models (Opus/Sol) but will become obsolete within a year as Fable-class models become cost-accessible and enter the workforce at scale
• High-end models make grade-school judgment errors daily despite exceptional coding and analysis abilities — they lack the maturity to see full consequences before acting, creating an awkward transition period before AI reaches workforce-ready judgment levels

Amazon quietly removed requirements for human oversight from its internal AI policy templates, shifting responsibility to automated detection and enforcement tools. Critics warn that relying solely on automation could miss nuanced bias and safety issues, undermining effective model governance.

• Amazon removed human-in-the-loop requirements from internal AI policy templates, relying instead on automated detection tools like anomaly detectors and preset filters.
• Amazon told EU AI Act consultation its automated Risk Control Framework achieves 98%+ detection rates, based on in-house red-team testing.
• A test showed an AI tutor prompt to help a student cheat slipped past filters because it contained no explicit policy-violating terms, illustrating gaps in automated review.
• Critics warn automated-only moderation misses subtle bias and context-dependent risks, potentially allowing models to drift into unsafe territory like medical misinformation or coded extremist content.